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ANTI-ALIASING LOW-PASS BLUR FILTER FOR 
REDUCING ARTIFACTS IN IMAGING APPARATUS 



BACKGROUND OF THE INVENTION 
5 Technical Field 

The present invention pertains to a low-pass optical filter used in 
an electronic imaging system to reduce aliasing or undersampling 
artifacts. 

10 Background Art 

An electronic imaging system typically produces a signal output 
corresponding to a viewed object by spatially sampling an image of the 
object in a regular pattern with an array of photosensitive elements, 
such as, for example, a charge-coupled device (CCD) solid-state image 

15 sensor. In such an imaging system, it is well-known that components 
in the object which contain fine details create frequencies too high to 
be analyzed within the sampling interval of the sensor and contribute to 
the amplitudes of lower frequency components, thereby produce 
imaging errors commonly referred to as aliasing or undersampling 

20 artifacts. In particular, if the spatial detail being imaged contains a high 
frequency component of a periodicity smaller than the pitch of the 
photosensitive picture elements of the solid state image sensor, the 
subsequent detection of this high frequency component tends to result 
in a spurious signal due to aliasing. 

25 In general, the electronic imaging system can minimize aliasing 

if its optical section has a frequency response that cuts off, or filters 
out, the higher frequency content of the object being imaged. As a 
result, the optical section generally employs an optical low pass filter 
to substantially reduce the high frequency component contained in the 

30 spatial detail of the image received by the image sensor. Thus, prior 
art design of electronic imaging systems involves a trade-off between 
image sharpness and the susceptibility of the imaging system to aliasing 
distortions or undersampling artifacts. 

To limit these artifacts, an optical filter, for example, a 

35 birefringent blur filter, has become a common component in consumer 
color video cameras. U.S. Patent Nos. 4,101,929 and 4,896,217 show 
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typical examples of such filters. Such a filter is usually placed between 
a lens and the image sensor to provide a low-pass filter function which 
reduces the spatial frequency content of the object at frequencies above 
the Nyquist frequency of the photosensitive elements. This makes the 
5 imaging system less susceptible to aliasing distortion. For example, for 
sensors which have equal pixel densities in each of the sensed colors, 
thus each of the sensed colors have the same Nyquist frequency, an 
achromatic low-pass, or "blur," function is effective in minimizing 
aliasing distortion. Such a function can readily be provided by a 

1 0 birefringent filter. 

The birefringent blur filter is typically composed of filter plates 
manufactured from a crystalline material like quartz that exhibits a dual 
refraction effect when the crystal axes of the filter plates are oriented at 
an angle with respect to the plate surface. In this orientation, a 

15 randomly polarized ray of light passing through such a filter plate 
emerges as two separated polarized rays. The combination of several 
of such plates produces a multiple spot pattern from each incident point 
in the image. If this spot pattern distributes light energy over multiple 
photosensitive elements, then the blur effect is obtained. This will limit 

20 the optical transfer function of the system at spatial frequencies above 
the Nyquist frequency of the photosensitive elements. 

One of the most common blur filters in the prior art is the four 
spot filter made of crystal quartz plates. Quartz is a uniaxial crystal, 
namely, it has one unique direction called the crystal optical axis so 

25 that when light propagates along this so called ordinary direction, the 
index of refraction for all polarization directions is the same and it is 
designated "N 0 ." For light propagating perpendicularly to this axis^ 
^jFse so called 4he- extraordinary direction, the index of refraction is 
"N e ." If a crystal 10 is cut as shown in Figure 1, so that the crystal 

30 optical axis 12 is at an angle a to a line normal to the input facet 14, 
then an incoming unpolarized ray 16 will be split into two rays. This is 
known as double refraction. One ray will continue unaffected and is 
called the ordinary ray 17. The other ray, called the extraordinary ray 
18, will emerge from the crystal displaced from the ordinary ray. The 

3 5 separation between the rays is given by: 
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Equation 1: 

S=t* (N G 2 -N e 2 ) * Tan(a)/(N G 2 +N e 2 * Tan 2 (a)) 

N 0 is the ordinary index of refraction 
5 N e is the extraordinary index 

For crystal quartz at 546 nm: 

No=1.5462 and Ne= 1.5554 
t is the plate thickness 

a is the angle between the crystal optical axis and the 

10 normal to the surface of the plate Maximum separation (S) occurs 
when the angle a is about 45°. 

One way of making a four spot filter 20 is by using two crystal 
quartz plates 21 and 23, double refractors, as shown in Figure 2, with a 
.quarter wave retarder 22 between them. A similar four spot filter 

15 ^suggested by Sato in U.S. 4,626,897. Figure 2 shows the three pieces 
separated, but ordinarily, they are cemented together. The first double 
refractor 21 separates the beam into two beams with, for example, a 
separation in the vertical direction. The retarder 22 converts the two 
linearly polarized beams 17 and 18 into circularly polarized beams 27 

20 and 28 which are then split in the horizontal direction by the second 
double refractor 23. 

Using Equation 1, if the pitch of a given CCD detector size is 9 
|jm, the preferred separation S for a square four spot filter is equal to 9 
|Lim. Substituting S=.009mm in the equation above, the required plate 

25 thickness t for the two double refractors is 3.04mnL (This does not 
include the thickness of the retarder in between). This large thickness 
of 3.04 mm is due to the small birefringence, namely the small 
difference between the indices of the crystal quartz, N o -N e =.0092. 

Figure 3a shows another way of producing a square, four spot 

30 blur filter 30 according to the prior art. In this case, a first double 
refractor 21 is used as in Figure 2 to separate the spots, for example in 
the vertical direction, as shown in Figure 3b. This shows the spots at a 
detector plane 24 when only the first double refractor 21 is used. 
Referring again to Figure 3a, the second double refractor 33 has a 

35 crystal axis in a plane 33a tilted at 45° . The thickness of the second 
double refractor 33, t 2 is smaller than the thickness of the first double 
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refractor, t 2 =0.707ti. Figure 3c shows spots that would be produced by 
the two beams at the detector plane 24 and their polarization in the 
coordinate system of the second double refractor. The second double 
refractor 33 splits each of the spots as shown in Figure 3d at the 
5 detector plane. 

Referring again to Figure 3 a, the third double refractor 36 has a 
plane 36a at 90° to the plane 33a of the second double refractor 33, 
and has the same thickness as the second double refractor. The third 
double refractor splits the beam again and a square pattern is achieved 

10 as is shown in Figure 3e. The double refractors are cemented together 
to reduce reflection losses. The filter assembly is aligned so the square 
pattern is parallel to the coordinates of the CCD which comprise an 
image sensor located at detector plane 24. 

The filters discussed above, however, suffer from the drawback 

15 that the thickness required to achieve the desired blur requires a lens 
with a long, back focal distance in order to make room for the blur 
filter in the optical path. Space limitations often do not allow such an 
optical structure, and lens design becomes unduly complicated. In 
most digital cameras, space is at premium and there is no room for a 

20 thick filter. For example, in cameras using a flipping mirror, the space 
in front of the detectors is needed for the mirror assembly. Also, when 
a digital camera which was originally designed as film camera is 
modified for use with a CCD detector, in addition to the mechanical 
problems associated with accommodating a thick blur filter, a lens 

25 designed for film may not perform as well with a thick filter, which 
may introduce aberrations. In these cases, a thinner filter is useful, 
which may fit the space constraints and will introduce less aberrations 
than a thick filter. 

Another problem with current art four spot filters is that they are 

3 0 commonly made of three pieces, either two double refractors and a 
retarder as in the Sato, U.S. Patent 4,626,897; or as in Figure 3a, which 
uses three double refractor plates without a retarder. A filter made of 
two elements would be less complex and less expensive. Watanabe 
U.S. 3,784,734 proposed a blur filter made of two double refractors for 

35 color image pickup using a striped filter array. Watanabe only needed 
to split the image spot into three or four spots along one direction, 
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perpendicular to the stripes direction. In most modern CCD images, a 
color filter array used is commonly a two-dimensional array of color 
filters as in Bayer U.S. 3,971,065, and a blur filter is required to split 
the imaging spot into four or more spots arranged in a two-dimensional 
5 pattern, so the Watanabe design would not be satisfactory. 

It is also well known in the art to use a phase diffraction grating 
as a frequency selective filter to produce an image blur. For example, 
as shown in U.S. Patent No. 4,998,800, the periodicity of an image of a 
diffraction grating projected onto a solid state image sensor is selected 

10 to be a multiple of the periodicity of the photosensitive picture 
elements, and a blurred image is obtained. This type of filter, however, 
suffers from the drawback that, instead of producing a tightly 
controlled pattern over a few photosensitive elements, it spreads light 
over many interference fringes (orders) theoretically out to infinity. In 

15 addition, it is difficult to control the energy distribution in the fringes in 
order to obtain an acceptable blur function covering a designated 
number of pixels. Moreover, the energy distribution is dependent upon 
wavelength. 

As can be appreciated from the foregoing remarks, there is a 

20 need in the art for a physically thin blur filter that is inexpensive and 
relatively simple to manufacture, yet which produces a tightly 
controlled blur pattern that is not dependent upon polarization 
techniques. As an alternative to the bireftingent blur filter and the 
phase diffraction grating, U.S. Patent No. 4,989,959 discloses a 

25 pyramidal structure comprised of four wedges which divide incident 
light into four quadrants so that light from the same image point 
impinges, on the average, on several photosensitive elements in the 
image sensing device. To produce four abutting facets at identical 
angles on a single piece of material, one facet would ordinarily be 

30 machined or ground into a single piece of material, the piece would 
then be cut into sections, and the sections glued together to form a 
piece shaped like a pyramid. This filter produces the desired spots at 
the CCD plane when the lens is at focus, however, as the lens is 
slightly defocused, the spots tend to blend and the anti-aliasing 

35 efficiency is diminished. Further, this anti-aliasing filter is positioned 
at the lens pupil (or at the exit or entrance pupil); not in proximity to 
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the imager. By placing the filter at the pupil, an auto focusing system, 
if present, may be confused. Also, the lens has to be designed to 
accommodate such placement of the filter. Since the filter is focal 
length dependent, it will not work with a zoom lens. 
5 Commonly assigned U.S. Patents No. 5,322,998 and No. 

5,438,366 disclose a conical blur filter that reduces undersampling 
artifacts by generating a blurred image produced by limiting higher 
spatial frequencies of incident image light. The blurred image takes the 
form of a circular blur pattern, for each input point source. Depending 

10 upon the shape of the filter, the circular blur pattern may be an annular 
blur pattern covering a two-dimensional array of photosites, or the 
central part of the pattern may be filled in with blurred light. Although 
this is a very good filter if there is ready access to the pupil, it too is 
located at the aperture and may confuse an auto focus system, if there 

15 is one, and will not work with a zoom system. 

SUMMARY 

It is therefore an object of the present invention to provide a 
physically thin blur filter that is inexpensive and relatively simple to 

20 manufacture, yet which produces a tightly controlled blur pattern that is 
not dependent upon polarization techniques. 

The aforementioned problems are solved according to a feature 
of the present invention by the use of an imaging apparatus for 
generating an image signal from incident image light having its higher 

25 spatial frequencies limited to reduce undersampling artifacts. The 
apparatus includes an image sensor for generating the image signal 
from an array of photosites, and an optical section having a highly 
bireftingent uniaxial crystal optical filter, such as lithium niobate, 
interposed in the path of the incident image light so as to produce a 

3 o blurred image on the photosites. 

According to another feature of the invention a four spot filter is 
made by using two plates made of highly birefringent crystal such as 
lithium niobate as double refractors with a quarter wave retarder 
between them. The three pieces are commonly cemented together. 

3 5 The first double refractor separates the beam into two linearly 
polarized beams with for example, separation in the vertical direction. 
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The retarder converts the two linearly polarized beams into circularly 
polarized beams which are then split in the horizontal direction by the 
second double refractor. For a spot separation of 9 jam, a filter made 
according to the present invention is only 0.46 mm thick compared 
5 with the 3.04 mm thickness of the prior art filter using crystal quartz. 
Calcite can also be used, however calcite is very hard to grind and 
polish. |ithium niobate on the other hand has a large bireftingent and 
can easily be ground and polished. / ^ 

Another aspect of the current invention is a rhomboidal four spot 

10 blur filter which uses a total of only two plates with their optical axis at 
45° to each other. The filter is rotated about the camera axis to 
efficiently reduce aliasing artifacts. Reducing the number of 
components in the filter reduces the cost of the filter and the cost of 
cementing since only one cementing operation is needed per filter 

15 instead of two. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Figure 1 is a perspective view of a prior art double refractor 
splitting an unpolarized beam into two displaced beams. 
20 Figure 2 is a perspective view of a square, four-spot blur filter 

according to the prior art using two double refractors and a retarder. 

Figure 3a is a perspective view of another four-spot filter 
according to the prior art using three double refractors. 

Figure 3b-3e are plan views of spots produced at a detector 
2 5 plane by the various components of Figure 3a. 

Figure 4 shows a perspective view of a rhomboidal four-spot 
filter made of two double refractor according to the present invention. 

Figure 5 shows a perspective, schematic view of a rhomboidal 
blur filter, rotated about an optical axis of a CCD camera so that an 
30 angle b is formed between the major axis of the rhomboid and the 
major coordinates of the CCD detector. 

DETAILED DESCRIPTION OF THE INVENTION 
vA The present description^&rected in particular to elements 

35 forming part of an apparatus in accordance with the present invention. 
It is to be understood that elements not specifically shown or described 
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may take various forms well known to those skilled in the art. For 
instance, geometrical relationships of the optical components are not 
shown or described in detail, except where necessary to describe the 
invention. Moreover, relative sizings of components shown in the 
5 figures are not meant to be taken to scale, since the necessary 
geometrical relationships and sizings can be readily discerned by one 
of ordinary skill in this art. 

Referring to Fig. 4, the preferred embodiment of a blur filter, 
referred to in general by numeral 40, according to the present invention 

10 is shown. A first double refractor 41 produces polarized light at each of 
the two spots. A second double refractor 45 has a plane 42, that is 
tilted at 45° to a first plane 43. The polarized light beam created by the 
first double refractor 41, will be essentially unpolarized in the 
coordinate system of the second double refractor 45. The thickness of 

15 the two plates is the same, namely ti=t 2 . In this case the four spots at 
the detector plane 46 form the shape of a rhombus, namely a 
parallelogram with equal sides. When the thickness of the two double 
refractors are not equal, namely t^t 2 , the four spots form a rhomboid at 
the dector plane, namely a parallelogram with equal opposite sides. 

20 In the preferred embodiment the double refractors are made of a 

highly bireftingent uniaxial crystal material such as lithium niobate. 
The birefringence of lithium niobate is 0.09, however, any uniaxial 
crystal material having a birefringence of greater than 0.05 falls within 
the scope of this invention. The birefringence of crystal quartz is only 

25 0.009. The large birefringence of the lithium niobate is used to 
minimize the thickness of the blur filter. For CCD detector with pixels 
pitch of 9 |im, the preferred separation is about 11 (xm (s= 11 jam). 
Using Equation 1 we find that the thickness of each of the double 
refractors is ti=t 2 =0.29 mm for a total thickness of 0.58 mm for the 

3 0 rhombus blur filter. 

One problem in using lithium niobate is that the indices of 
refraction are about 2.3 and that there is no cement with such a high 
index. Thus it would be difficult to easily cement two pieces of lithium 
niobate without reflection losses due to refractive index mismatch. 

35 There are at least two solutions for this problem One is to precoat the 
lithium niobate surfaces to be cemented with an anti-reflection coating 
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designed specifically for the chosen cement and the lithium niobate 
interface. Another solution is to keep the lithium niobate pieces 
separated by a small gap and coat the lithium niobate surfaces with an 
anti-reflection coating designed for air-to-lithium niobate interface. 
5 In another embodiment, four spot filters are used as in the prior 

art in Figures 2 and 3 however, the crystal is changed from crystal 
quartz to lithium niobate so as to substantially reduce the thickness of 
the filter. As explained before, a 9 Jim four spot filter, the thickness 
will change from 3.04 mm for crystal quartz to 0.46 mm for lithium 

10 niobate. (The retarder thickness is not included in either case.) 

For the four spot filter depicted in Fig. 3a-3e, with the sides 
equal to 9 [im, the thickness of a filter made of crystal quartz according 
to the prior art is 1.52 mm for the first piece and 0.707*1.52=1.07 mm 
for each of the two other pieces for a total of 3.66 mm. The same filter 

15 made with lithium niobate will have a thickness of 0.23 mm for the first 
piece and 0.707*. 23=0. 17 mm for each of the two other pieces for a 
total of 0.55 mm. 

Another embodiment of the present invention, imaging apparatus 
(\ 50, is shown in Figure 5 'where a two piece rhomboidal filter 51 

20 comprised of a first retarder 52 and a second retarder 54,4s- shown in a 
CCD camera is rotated about an optical axis of a camera to further 
0^ reduce aliasing^so that an angle y is formed between the rhomboid base 
and the major coordinates of the CCD detector. The preferred angle y 
is 30° but valueg ofy between 20° to 40° are suitable. Spots 58 are 

25 produced at^^^^plane 62 comprised of photosites 63. A lens 60 
focuses the desired image. 
H lithium niobate crystals are not found in nature. They are 

commonly grown from melt using the Czochraski pulling method and 
commonly form boules 4 inch or 3 inch diameter with the crystal 

3 0 optical axis (the z axis) aligned along the axis of symmetry of the 
boule. In yet another embodiment according to the present invention, 
the optical axis of a a lithium niobate crystal as shown in Figure 1 and 
4 is chosen to be 37.85° instead of 45°. This angle is chosen to align 
the retarder plane with a major principal crystal direction called the 

35 10.4 direction or the "127.85° Y cut" by crystal growers A It is possible 
to grow the boule along this direction so that its axis of symmetry 
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aligns with this direction and thus the crystal axis already forms the 
angle a with the boule axis of symmetry so that wafers cut from the 
boule already have the crystal axis at the desired angle a with the 
plates surfaces as shown in Figure 1 without having to cut the boule at 
5 an angle to its axis of symmetry. This simplifies the production of 
lithium niobate double refractors and reduces their cost. The change of 
the angle from 45° to 37.85° increases the needed thickness according 
to Equation 1 by a small amount compared with a similar filter oriented 
at 45°. For example a rhombic filter with 11 \im size sides is 0.29 mm 

10 instead of 0.23, so the total filter thickness is 0.58 mm instead of 0.46 
mm for the 45° design. 

The invention has been described in detail with particular 
reference to preferred embodiments thereof, but it will be understood 
that variations and modifications can be effected within the spirit and 

15 scope of the invention. 
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